This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 

IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



THIS PAGE BLANK (uspto) 



cited in the European Search" 
Report of EPOY/H <$}%Q £f 
Your Ret :K£2)4 .(\m(pM)^ 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 6 : 
H04Q 11704, H04J 3/06 



Al 



(11) International Publication Number: WO 95/22233 

(43) International Publication Date: 17 August 1995 (17.08.95) 



(21) International Application Number: PCT/CA95/O0062 

(22) International Filing Date: 10 February 1995 (10.02.95) 



(30) Priority Data: 

9402638.2 
9402770.3 



1 1 February 1994 (1 1.02.94) GB 
1 4 February 1 994 ( 1 4.02.94) GB 



(71) Applicant (for all designated States except US): NEWBRIDGE 
NETWORKS CORPORATION [CA/CA]; 600 March Road, 
P.O. Box 13600 t Kanata, Ontario K2K 2E6 (CA). 

(72) Inventor; and 

(75) Inventor/Applicant (for US only): BESSETTE, Francois 
[CA/CAJ; 24 Poullart Street, Gatineau, Quebec J8V 2C6 
(CA). 

(74) Agent: MITCHELL, Richard, J.; Marks & Clerk, P.O. Box 
957, Station B, Ottawa, Ontario KIP 5S7 (CA). 



(81) Designated States: AM, AT, AU, BB, BG, BR, BY, CA, CH, 
CN, CZ, DE, DK, EE, ES, H, GB, GE, HU, JP, KE, KG, 
KP, KR, KZ, LK, LR, LT, LU, LV, MD, MG, MN, MW, 
MX, NL, NO, NZ, PL, PT, RO, RU, SD, SE, SI, SK, TJ, 
TT, UA, US, UZ, VN, European patent (AT, BE, CH, DE, 
DK, ES, FR, GB, GR, IE, IT, LU, MC, NL, PT, SE), OAPI 
patent (BF, BJ, CF, CG, CI, CM, GA, GN, ML, MR, NE, 
SN, TD, TG), ARIPO patent (KE, MW, SD, SZ, UG). 



Published 

With international search report. 

Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



(54) Title: METHOD OF DYNAMICALLY COMPENSATING FOR VARIABLE TRANSMISSION DELAYS IN PACKET NET- 
WORKS 



INCOMING PACKETS 

□ □□ 



20 



21 



VARIABLE DELAY 
UNIT 



PACKET 
ANALYZER 



24 



ZT 



SPEECH PLAY-OUT 
BUFFER 






FILL I 
- M0N 


£VEL 
IT0R 



CONTROL UNIT 



-A 



22 



SPEECH 
RECONSTITUTES 



25- 



SPEECH 
SAMPLES 



D-T0-A 
CONVERTER 



23 



ANALOG 

(57) Abstract 

A method is described for playing out packets, such as voice or video packets, received through a packet network subject to variable 
transmission delays. The incoming packets are received in a delay buffer and a predetermined delay applied to the first packet of ^sequence 
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METHOD OF DYNAMICALLY COMPENSATING FOR VARIABLE 
TRANSMISSION DELAYS IN PACKET NETWORKS 

This invention relates to a method and apparatus for 
dynamically compensating for variable transmission delays 
5 in packet networks, particularly voice networks, but the 
invention is also applicable to other networks, such as 
video networks. The invention is applicable in all 
integrated packet networks where voice or video may be 
carried including, for example, frame relay networks, ATM 
10 networks, PCME (packet circuit multiplication equipment) , 
and LANs. 

In this specification, reference is made throughout 
to "voice" packets, since this is the term normally used 
in the art to describe such networks, although it will be 
15 realized by one skilled in the art that such networks 

extend to any network capable of transmitting any form of 
audio whether it actually be voice or other form of 
reproducible sound. 

Two methods have been proposed to compensate for 
20 variable transmission delays in packet voice networks. 

In the first method, known as timestamping, which is 
used in ITU standard G.764, the accumulated /variable 
transmission delay experienced by a voice packet is 
recorded in a timestamp field in the packet. Each 

25 intermediate node recognizes voice packets and adds to 
the timestamp field the amount of time that it took for 
the packet to transit the node. The receiver uses the 
value in the timestamp field to determine when to play- 
out the voice packet. Voice packets that experience 

30 little delay in the network will be delayed in the 
receiver longer before being played-out, and voice 
packets that experienced long network delays will be 
delayed less in the receiver. The effect is that the sum 
of the network delay and the delay in the receiver will 
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be nearly constant for all voice packets and the voice 
will be played-out at a uniform rate. 

The disadvantage of this method is that intermediate 
nodes must recognize voice packets and carry out special 
processing. This makes this method incompatible with 
existing networks that do not support this function. 
Another disadvantage is that prior knowledge of the 
maximum expected delay variation is necessary. 

In the second method, known as the blind delay 
method, a fixed delay is always added at the receiver to 
the first packet of a talk sequence. The delay 
corresponds to the maximum variable delay expected from 
the network. This way, if the first packet experiences 
minimum delay, the system compensates by adding enough 
delay to make sure other packets, which experience more 
delay, arrive before their scheduled play-out time. 

The disadvantage of this method is that it may 
increase the delay in the voice path beyond the optimal 
value. This is because if first packet has already 
experienced the worst case delay, the delay added will 
include the worst case twice. Large delays degrade the 
system performance (or may cause the system not to meet 
the international standards for network delays specified 
in ITU-T Recommendation G.114) . Delay is of special 
25 concern when speech and facsimile demodulated traffic are 



mixed on the same transmission facility. Another 
disadvantage is that prior knowledge of the maximum 
expected delay variation is necessary. 



15 



20 



30 



According to the present invention there is provided 
a method of playing out packets received through a packet 
network subject to variable transmission delays, 
comprising the steps of receiving incoming packets in a 
buffer,- applying a delay to the first packet of a 
sequence of packets; applying a variable delay to 
35 subsequent packets of the sequence to produce an 
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appropriate constant play-out rate to reproduce the 
desired output; monitoring utilization of said buffer; 
and adjusting the delay applied to the first packet of a 
following sequence of packets to maintain said 
5 utilization within desired limits to minimize the risk of 
said buffer underf lowing or overflowing. 

The utilization monitored can be, for example, the 
buffer fill level or the dwell time of packets in the 
buffer. Alternatively, the arrival rate of the packets 
10 could be monitored. 

The packets may, for example, be voice packets or 
video packets. 

The invention (Adaptive Delay Equalization) thus 
uses an adaptive method to determine when to play- out 
received packets. This method minimizes the delay 
applied to received packets. In a preferred embodiment, 
the receiver starts by applying a pre -determined delay to 
the first packet of a talk-spurt. The receiver delays 
subsequent packets by an amount appropriate to produce a 
constant gap- free play-out rate. If the minimum number of 
packets in the buffer is large (i.e., the buffer is never 
close of under- flowing) , the system slowly reduces the 
predetermined delay, known as the build-out delay, if 
packets arrive late, the build-out delay is increased in 
25 order to minimize packet loss. The build-out delay 
adjustment can be done during speech silence. The 
duration of gaps between spoken words is precisely 
replicated by sending a 'silence duration' value in the 
first packet of each new talk spurt . 

This method has the advantage that it minimizes the 
delay when the network is not congested, adapts itself to 
operate optimally in various network conditions, without 
any user reconfiguration, and it does not require any 
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complicated and specialized node handling of voice 
packets (e.g. time- stamping) . 

The invention also provides an apparatus for playing 
out packets received through a packet network subject to 

5 variable transmission delays, comprising a buffer for 
receiving incoming packets; a speech reconstituter for 
receiving said packets from said buffer and 
reconstituting speech samples therefrom; a variable delay 
unit for a applying a delay to the incoming packets; a 

0 control unit for controlling said delay to apply a first 
delay to an incoming sequence of packets and a variable 
delay to subsequent packets of the sequence so as to 
produce an appropriate constant play-out rate to said 
buffer; means for monitoring the utilization of said 

5 buffer; and means for adjusting said first delay applied 
to the packets of a following sequence of packets to 
maintain said fill level within desired limits to 
minimize the risk of said buffer underflowing or 
overflowing . 

0 The invention will now be described in more detail, 

by way of example only, with reference to the 
accompanying drawings, in which :- 

Figure l is a schematic diagram showing a variable 
transmission delay packet voice network ; 

> Figure 2 is a timing diagram of a packetized voice 

transmission system in accordance with the invention; and 

Figure 3 is a block diagram of a variable delay 
compensation apparatus in accordance with the invention. 

As shown in Figure l, a speech input is transmitted 
) in packetized form through a packet network 2, for 

example an ATM or Frame Relay network, which introduces a 
variable delay during transmission through the network. 
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The incoming packets are received by receiver 3, which 
outputs a re-assembled speech signal. 

The packet network 2 introduces a variable 
propagation delay A. Receiver 3 introduces a further 
5 delay 8 in the manner to be described. 

Referring now to Figure 2, input speech consists of 
spurts 4 separated by periods of silence 5 . Each spurt 4 
is represented by a sequence of packets 6, which when 
they are transmitted are separated by fixed spaces 7 as 

10 shown at line 8. However, after transmission through the 
network the packets are no longer equally spaced, as 
shown at line 9, due to the variable propagation delays 
in the network. In accordance with the invention, as 
shown at line 10, the first packet 6a of each sequence is 

15 subjected to a predetermined delay, which is estimated to 
be adequate to avoid buffer underflow and overflow. The 
remaining packets of the sequence are subjected to 
variable delays to maintain the appropriate constant 
output 11. This is then decoded to reproduce the initial 

20 speech as shown at line 12. 

Referring now to Figure 3, the incomiiig speech 
packets 6 are fed to variable delay unit 20, which 
introduces a variable delay between the packets. The 
output of variable delay unit 20 is fed to speech play- 
25 out buffer 21, which outputs the speech packets to speech 
reconstituter 22, which turns the speech packets into 
constant rate speech samples, normally at 8KHz . These 
speech samples are then converted into analog speech 
signals in digital -to- analog converter 23. 

30 Incoming speech packets 6 are also fed to packet 

analyzer 24 whose function is to identify the start of a 
speech spurt and trigger control unit 25, which sets the 
delay introduced by the variable delay unit 20 so as to 
produce a constant output rate. Buffer fill level 
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monitor 26 monitors the fill level of speech play-out 
buffer 21. Depending on the fill level of buffer 21, 
control unit 25 varies the initial delay for the start of 
the next talk spurt. Monitor 26 can be replaced by a 
5 similar unit monitoring the dwell time of the packets in 
the buffer. Alternatively, the buffer utilization can be 
determined by monitoring the arrival rate of the packets . 

In operation, the control unit 25 applies a pre- 
determined delay to the first packet of a talk-spurt 

10 detected by packet analyzer 24. The control unit 25 then 
delays subsequent packets by an amount appropriate to 
produce a constant play-out rate to the speech play-out 
buffer 21. If the minimum number of packets in the buffer 
is large (i.e., the buffer never becomes close to under - 

15 flowing) , the control unit 25 slowly reduces the build- 
out delay. If packets arrive late, (i.e., the buffer 
risks under- flowing) , the build-out delay is increased in 
order to minimize packet loss. Adjustment of the build- 
out delay can be determined in a number of ways, such as 

20 monitoring the minimum, maximum or average utilization of 
the buffer. Alternatively, it is possible to monitor the 
time a packet spends in the buffer. 

Preferably, the delay adjustment is done during 
speech silence. Normally, the duration of gaps between 

25 spoken words is precisely replicated by sending a silence 
duration value in the first packet of each new talk 
spurt, which can be detected by the packet analyzer 24. 
when the build- out delay has to be increased, the silence 
duration is artificially increased. The result is a 

30 larger build-out delay during the next talk spurt. When 
the build-out delay has to be decreased, the silence 
duration is artificially decreased. The result is a 
shorter build-out delay during the next talk spurt. 

Although the preferred embodiment has been described 
35 with reference to audio signal, the invention may also be 
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applied to video transmission, in this case video packets 
carry the video data, and the speech reconstituter is 
replaced by a video reconstituter, which operates in an 
analogous manner. Indeed the invention is applicable to 
5 any digitized physical signal that is transmitted in 

packetized format and then reconstituted at the far end. 
The video implementation looks the same as the 
implementation shown in the drawings with the word 
"video" substituted for the word "speech" throughout. 
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Claims : 

1. A method of playing out packets received through a 
packet network subject to variable transmission delays, 
characterized in that it comprises the steps of: 

5 a) receiving incoming packets in a buffer; 

b) applying a delay to the first packet of a 
sequence of packets 

c) applying a variable delay to subsequent packets 
of the sequence to produce an appropriate constant play- 

10 out rate of said packets to reproduce the desired output; 

d) monitoring the utilization of said buffer; and 

e) adjusting the delay applied to the first packet 
of a following sequence of packets to maintain said 
buffer utilization within desired limits to minimize the 

15 risk of said buffer underf lowing or overflowing. 

2. A method as claimed in claim 1, characterized in 
that in step d the fill level of said buffer is 
monitored. 

3. A method as claimed in claim l, characterized in 
20 that in step d the dwell time of said packets in said 

buffer is monitored. 

4. A method as claimed in claim 1, characterized in 
that said packets are voice or audio packets. 

5. A method as claimed in any of claims l to 4, 

25 characterized in that each said sequence represents a 
signal spurt . 

6. A method as claimed in claim 5, characterized in 
that said delay adjustment is carried out during signal 
activity in the gaps between signal spurts. 

3 0 7. A method as claimed in claim 5, characterized in 
that a signal inactivity duration value is inserted in 
the first packet of each spurt . 
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8. A method as claimed in claim 1, characterized in 
that said packets are video packets. 

9. An apparatus for playing out packets received 
through a network subject to variable transmission 

5 delays, comprising: 

a) a buffer for receiving incoming packets; 

b) a signal reconstituter for receiving said packets 
from said buffer and reconstituting signal samples 
therefrom; 

10 c > a variable delay unit for applying a delay to the 

incoming packets ; 

d) a control unit for controlling said delay to 
apply a first delay to an incoming sequence of packets 
and a variable delay to subsequent packets of the 

15 sequence so as to produce an appropriate constant play- 
out rate to said buffer; 

e) means for monitoring the utilization of said 
buffer; and 

f ) means for adjusting said first delay applied to 
20 the packets of a following sequence of packets to 

maintain said buffer utilization within desired limits to 

minimize the risk of said buffer underflowiriq or 

/ 

overflowing. 

10. An apparatus as claimed in claim 9, characterized in 
25 that said means for monitoring the utilization of said 

buffer comprises a buffer fill level monitor. 

11. An apparatus as claimed in claim 9, characterized in 
that said means for monitoring the utilization of said 
buffer comprises a monitor determining the amount of time 

30 the packets spend in the buffer. 

12. An apparatus as claimed in claim 9, characterized in 
that it further comprises a packet analyzer for detecting 
the start of a signal spurt. 
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13. An apparatus as claimed in claim 7, characterized in 
that said delay adjustment is carried out during the gaps 
between signals to be transmitted. 

14. An apparatus as claimed in claim 9, characterized in 
that said packets are voice or audio packets. 



15. An apparatus as claimed in claim 9, characterized in 
that said packets are video packets. 
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